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(54) VOICE RECOGNITION DEVICE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To obtain a voice 
recognition device having a language model which gives 
zero or a very small value as a bigram probability for an 
abnormal word chain even though the amount of corpus 
is not sufficient. 

SOLUTION: The device is provided with a language 
model hierarchy determining means 12 which has a 
statistical language model having a hierarchical structure 
and determines an optimum hierarchy to compute a 
language bigram by a preceding word, and a language 
likelihood computing means 13 which gives a very small 
value to the language likelihood of a strange word chain 
while considering the frequency of the appearance of an 
optimum hierarchy class for the bigram probability of the 
chain word. Then, zero or a small value close to zero is 
given as the probability for an abnormal word chain to 
improve the recognition performance/processing speed. 
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striaif§^f ; ;HB«#ecciBtf.3n-ci,^iKttwmf5* 20 
«nE i twaaw«*a©fH» u /ctgiiM&©^gyL& 

4 -T &*Plgn8B. 30 

it** 1 IB*8©^®S^g„ 
[19*313] tttH-«J3H*^l'tt. iteff#Hi. Sttft 

i£f§#ji u r c» -5. aw&nm® z?* ic*» zmm - ? 

*©#i§M-f ^A©fg^<B*0J:»)*S<,MilK: 

IS. 

[I9#J15 ] ttWW«H*^i'K:*W45feff#BK:« 
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-rSf»#Jl 1 IBifi<Z)*PI8ttatB. 
[»#3I8] SBf-flHfflHe?'*!*. »Jl*»*fc-3* 

tr*»*si 1 iB*s©w^is^^a. 

[000 1 ] 

c»b©hts«»s#»] commit. ^w.mmmc 

[000 2 ] 

[ft*©i£ffi] HI 5» r«FBBgB««Mc»fb^SftttM 
ol. 95, No. 430, pp63~pp68, 19 

95*12^140) icmmztitc. mtttims*:?* 

*t^©> 3BHMM dShv*3 7tf*) ^gi^f^ 

tatst#&. 4«#is^«iBte#©. 5«^ps*ait»# 
[0003] -x^mc^xwmt z>. cct, si 

2 »#B»»©JI«c«*^iKiWH. H13«#IS©H 

*s. sfc. hi 6»hi 5iC7nLtcmi(o^mmm 

[0 0 0 4] HI 6<Dya-? + -b<tCnkLtcm{?Z&l 
te-r-StCyttro-C. St, HMMfH»*^UE«¥S3 

awaraattsaK (B^tK) ^^hmm^is^^ju©-?" 
k. ±fa^1•gl5f^t^s^6*iss^s ; &^ji^rfatf.•r 

4. c©mii^*«Hi 2«:7f;-r«fc5(c > #mt§tco(,^ 

[0005] s e.«:#iss«ia«^S4« 1 s#t§©^ 

1 3 ttHMMt8*7 : *©«lS«!l*wl/fc*>©'C*») , 
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CiCC J; 9. ZmMKHMM^^TtoZm 
[0006] #tCg^8W##£8 1 tt. SI 6©* 7-? 7" 

© (S^BS) «> 7"ST2{C*Jt^-CB#S"Jt?rCT 

mmt itt = o tcis^-r ^. acfcwwm^a i «. 

W£fttiT^&2teZ7-v 7*ST4«:*jiir. mo 
m-jits. &(c. ^s*aitff^5«x^->^sT5 

tcfcur, ^g#tfc^f *$J:o'HMM 

[ o o o 7 ] h 1 4 iz&mmfcisttzzsmmisicDm&iv 
HMMtft&gctti ib-cos, Efctenr. -en-eti© 
i^©^. *h»sh:*s. ftm&^ 

mil* rte*j 7i/-A (B$gij) jwafT-rs 

KotlT. HMM»*f , ^*JeBJl'-^LrS3feWa 

•}>< C&fcttS. #tc T|B*j ©1^©**/ i 

(HI 4©*#©ISI&[Sift) ^©SSWUKS 

»tSAi, rta^j ©;x«c« r«j , rimj , rii * 



[000 8] JfcK. M»fcflSW*«7 tt*^» T 
etc*!,*?. *SS^*tTofcaa©S^MRitt«:-^C> 

^^t^ccsaxotettiiu *©*rtttt-c*4*f 

■r*ct«cj:ora«M8^*a[*iW-r*. c© 
ms*s©»fflKot>-c«tg«:si?Br4. 

10 [0 00 9] Hct&W LfclNffli^iSKX f-;^ 

ST 7 icis^X. ^A**J»7U?t*>5*» J gr«iHlU. 

t*t + l(C-/>i"Jj(>H / tiiai^f^ST3 
KRU s»^ST3*>6^f ??"ST6*t?© 

7KT*RWM>te7as|ftWS*iS£. lStaiJ£Jilffl;*J# 
S8«Xf ^^ST9{C*J(<»r. ^©^EBJCfcl^-C 

20 -r^. 

[ooio] c c-c. *©«f§*K©W^L©B«ffl{c-ot,> 
■riiMiri-s. sHjtasiittiwmwe^^ffli^tis 

N^AtfATB. mi§?iJW=w 1 w, -w„ ©SH 
(w, w, -w„ 

r. OTfc^bfcsS ( i ) 

[0 0 1 1 ] 

[ftl] 



P(w,w 2 ...w„) = nP(Wi I w i . 1 w i . 2 ...w j _ N+1 ) 
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[0 0 12] ftfc. ±iESC (1 ) -CN = 2©i*^^^ 
5A> N=3©£# h^-f^Ail,^. (1 ) CCfc 

-st*SJ») ST «TrtttOTWb©fc«>. N 

= 2©/N'-C^A^f r Jl'*|ftBJ©fcJ*{CflBt^*5. N>* 



SlS^Stt^©^ (2) ©JrSKttS. 
[0013] 
[»2] 



P(W!W 2 . ..w„) = II P(Wi I w M ) 



= P(W, I W 0 )P(W 2 I Wi)... 
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[0 0 14] ic^-c, ctie©*#m*w*B. — * 



★ ©C i%3-^^9©^^-^tti0>5. C©<fc5&*B 
£\ OTic^-r^ (3) ©<fc5fc:*A-j;>^£-fS» 

[0015] 



P(wlx) = (1-a) • N <x. w) /N (x) 

(N (x. w) >0©i&£) 
P (w I x) =a • P (w) (N (x. w) = 0©ig£-) 
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[0016] cct, ±§2S; (3) {c*ii>r. n (x. */c«>k:. aw*-/ y?i*tj:£<Dwm*:?}\<*m^zm£t 
w) ^rj-^-^grttc^-rs^Sx-woaiii©^ c©«te. ¥§Sx. w«-en-eti©a D a f^c, d 

N (x) «3-^'^9rtCC#&-rsmi§x©^ P CCJlfS^CDi-r-Si. ^©s; (4) *«?*e>ft£„ fc 

(w) U&HwO^^Aflff. a«XA-i^>^© tcb. C©5£ ( 4 ) * . ¥lgc ttAHC<C0r*-&¥l8CC 
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[0017] s/c, n-^^go^^^-xtt^Eija-r-s* toois] 

P (w I x) = P (C I x) - P(DIC) - P(wlD) 
P <D I C) =N <d. c)/N(c) 
(w I D) =N (w) /N (d) 
(C I x) = 1 
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[ w&m®: l j: 5 i -r -s aw ] r &*mmmm¥£&. 

S£*©w^^s«JW±©«t 5 tew j5R3im»a© 
r. 3 -^X 9 ©«#+#•?& a ifitm 

P ( "IB" I "ffl^" ) = a • P 
[0 02 2] AfPM ^7A«rffl«,»fc«^-C<>. 
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P ( "IB" I "H£" ) = P ( "*P 
) • P ( "IB" I "«W" ) > 0 
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[002 8] CQAHtCffiS^rail&BtS. jt!f*» 

£. «ijy|iH36«Biiyri>*jW!jaHJi©i'^^«:*»tfs 
mm- xaiK© 3 *©tH3§aafl»* o «t o a* 

<. *>o. =j-^rt©^^<^^^A©tH^«S*so 
©*B^«c». ■e©^S-'AV^A©Sg^«i4 0J:«3At 

[0029] c^Kffs^mnniB. ttti«m 

[0 03 0] C©^BJKl^S^^^g«. 
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Ltct><DXS>Z>. 10 
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[^^©HJfe©^] OT. C©»B©**©-JBJB* 

f-fto -cKttr itwwfar * o . 2 « c ©# 

WWC**. 3»HSv*«HSLfcJ1-aSEtKBai*6H 
MMtftt-tf^fcBM&fc*. ^©HMM^ffl^TVl-'&E 

it^-S-C* 0 . 4 tela) D < H^*«BS Ofc*MPEtt«BB 

a»6*H#» ) fc**i&#. *©*«sw*Efrrs#aa 

SWEttfMfrC**. 5ttfF*&ffi#&2 J; Otll* 3*a 30 
fBt83irrt>'SHMMWia j &f t .>k feJcCWMSSHMBtt 

i»r©«ftfca*tiiitr4«^aaH**S'c*4. 8 

WftBMMJiff*W*-r4IS«tS*W*#I!l'C*4. 9tt 

^omsx&zstn? s *:#©<&## * * ir 

[0 03 5] ttfc. CtJ6*WW»S 1 . 
82. HMMW»*?0UEtt*S3. *iSf^«IBtfi!*l2 40 
4. «ft«?UMM85. BKtS«lB^S8. aw* 

[0 036] io isttttwwH^^wftEttr aaffl* 

fi*feo«slttWIB*f r ^*E1*l/-Cl,>*ji&'t?, 015 
(C*?#6 ^f^lz-C^U/cSii^^UEtg^-etttSft 

fcfc. CflDKJBl'S-t^UEtB^ia 1 OCCEta 50 
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ztix^zmtttornn^^Mx. &&%m<DVti5itcfcc 
xmwmm<ow&*:7 : )\'ifi®mzftz>o 1 nmmm 
tveffrRW&mi o«ciB«3nri»*BHi«js**»-9 
/c®efi-W^ j ef r Ji'Ccoc>-r. -?-©|sgJl • ?7^©Si 
*Ettf SPSJI • tfy * JE«Ett*«"C* * . 1 2 fit* 

1 0<CEttSttTl»6i^l^l§*7 t ;U£#Jfgl,T. IS 

aMRS»©SH*tt*imti/-c. ^©af&fiirassstim 
IS^S <!: . ^S^SIt»#© 5 Wo "CIW 3 nytws 

ww s wmxm.3tw$-&x$> k> . mis* ^JUMRtie 

©#H*Ittf«#B i fcUttc otl>5. 
[003 7] yctCttmco^TSilBTS. C CT. 0 2 

0. 04i*Pgd^3&4WrS^iS*7 ; >'i'©> asfrWBx 

-rt&Hj0r* o.05 BaB*^HBflKi«e*s 1 2 © 
1 2 imm&m<DM#Mz^Ltcmm®. 0 1 3 ««n 
0-e*s. 

[003 8 ] S-f*»]K. 03fcJ:iy t 04*#flSO%** 

6> c©HJfi©0S8irflSt»6n-rc>spgJSW*mfi* 
^i-Koorsiwrs. 03«$feK«j**oiS ; &fflt,>r* 

B^KSfbO^KM • i>7^t»©-M'r5>4. C©« 
^•tcfi, JHH*5-3©(ll«:»tf, S±)l«p a 0 P. ST 

*fLr. C4. C3, -. C0O*7^l"<;l'!W^3 
titOS. FgJS • *5*!£aE«*f21 l»C©«fc^% 

• ^^x^a^EtSL-rc^s. 

[003 9 ] C©P§g • ^ 9*S»Ett*S 1 1 

{cEtSSnrt»-5±EFi)B • ^-7^*i> 3-^9 

«©«a*tHtt-r*. 04-c«x-w. oJranM«>=i 

w<*9rt-C50fHKSftA: <N <x. w, ) =5) C 

i*s%Lrt»4. pg«ag' ; ef r ^E«*K i o«cne. 

#K)l©mfgiilR©«S^5fetf^i§x jritcSHkLTE 
flTto<„ 

[0040]^t t c©H«g©^SSl«:J;^#^i2ii 
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TlfclJH-r-S. t©02©:7a-^-r- hiCTjkUtdnmW) 

*R3*i. 0^^«!«L./c^g|5f21t^g*'*=>HMM : g : gB 
•fcT^MD^- •e©HMM^gfl-=e7 ; ;l'*ie 

IS§*»£f3tg-rS. CC-C. £©!£§§£*#«. 

■en^tigl^lB. O^rts&SlfB. ^SaifB©^-** 
totl,>5. <*6tc. c®*i38MHett#&4t2&¥i3 

[ 0 0 4 1 ] H 1 3 ttCOHMMlPS-t^KD^M* 

$es rai^j /g/, /i/, /k/, / 

tB-r £ h MMti* ju* ST»*t:^ti6 *a*s-r s 

IffiSTS. ffi©*HCcoi>r*>c*itlHlttK:L-c 

[0042] -e©&. i t*s -r . * ^ 

S T 1 0 CCfcOT. A^Sn/c^^rA/D^L/Tf 1 

!>*jW-*fbU ^ti^^^-^iuriBtt-rs., 

is^rmMtzmmmtL-c t = ofttas-rs. 
i t < corns t = o ) tcfcwst 

^f»^ST 1 3{C*Jl»r. €•© 
[0 043] ^CC. $«*flHH-*3«5t**^* ?'S T 
/t#«S|tS^ f h Jt> <t HMMWSH^HBtfc^© 3 KiB 

c©^#a*s©w-#^ri*«. mx\m^A -22 
2 7 6#&#R&£'(cfcpg^3ftTt>3;g&©&©r*£ 

def 

N(x,C) = 2N(x,w) 

[ 0 0 4 9 ] Wfeotem. N ( x. C) *0r*ofcif 
^BXf^ST2 StCfcOT. IB5>JG ( i ) , -?tj;t> 

•5. ^f^7*ST2 6(Ctet»-C\ SPgJI i tC*$W6 
tfl-rSS-C^ 77"ST29f i5r-f>i";y>H/ 
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* [0 04 4] 0 1 4K:«§B3f£i| KfcW&tg 

cctlJStf©HMMW«i iu-r(r>4. 

i. 7u-A*st = o*ip, 1. 2, •ijitf^-stcon 
■rsisiiMsastftifjSft. i§f&Mt&©ifc#if;i"r*9>< c 

&tctt£. »«: ria*j ©i&iSS©^/ i 

^ 01 4 ©*^©ism<sift) ^oBamntcs&rs 
a*, ria^j AEfccctt rt^j . ritHj . r«#j . ... 
iss^s^mti^jB^L/^-sfc^ -e-©*s©fc©fc*t 

[0045] ^{c. matf^maa&m 1 2 

•^sti stcfco-c, SiSitMIStcrmig^^-r^ 
20 rkc. -e<o*H«conr©»a[ia:»ji*9ae-r*. f & 

[0 04 6 ] i5©7n-^t- htc^o-SH-tfJUf 

jg^s^e 1 2 «fc s9He*«ifif ©«w*w-r. ST* 

^•^7*ST20«:*Jt,=.rpg)li * i =o^cg;S-r-5. # 
CC^^v 7"ST2 1 (Cte^TiB^JG (i) 4G (i) = 
0Ktn*Mfr*. ^CK^^»^ , ST2 2CC*ft»'r»H» 

4j ^OtcS^^-^., »c^f^^ST2 3«:tei,> 
[0 04 7 ] ^K, f#6*lfcP&JB i©*7^C(C-oi> 

r> ftfffliigxtf ?^c»ci>i-r**Hw©*HaMi© 
;natt*Si otciattsftri^asitffJsiB*^*^ 

5j<«?) > !>yST2 4(C*Jt,it:^-ti*50-C*2>^S^ 
©*Be*ff5. C©N (x, C) ^XiCmLtc^ 

(7) (c<j;-,rsa$n^„ 

[0 04 8] 
[K3] 

• • • (7) 

[0 05 0] «±©^ffi*5^^^|ig-CiB??>JG ( i ) 

( i ) «iifjnfs©-e. t^^^setc^-rcfc^^aHi 

36»0©*-^K«t*. C©{?9r«. pgH2^e>Pf)13{C 
^SK«Cffi?tjG (i ) 3Wft»tly-ri»4. Chtt, P£@2 
50 ■C«#S**«O-Ct»4 4'7^©«a*i0t?&*ti^j6J^ 



<Dm&&oo>m-&izm'j>LXi,>z> (c ©»•£•» o 

7-v7ST3 0tCi$^X. G ( i + 1 ) -G ( i ) ifiM. 

[0051] corns, wmmofv^-c, n (x. 

C) =0-t?*S^7^C», 3-y^9(D^>^-^tt«: 
<fcr>Tfc£fc$^ft#ffl^L.Tt>&i>©T«&< . m 

P (w I x) = ( 1 - or) • N 
N (x, C) 

P (w I x) = a "P (w) 

N (x, C) 

P(w|x) =0 

coo54] x<£ft5&<D : gpimwi,ms£mmt<c> m^z 
b$sij t % t + l cc^f > * >; y > h or^a^xf- ? 

T12fCilU ±IS^7-^ST12i!p6^f"^ST 
[0 055] Jit±©J: Sic. C©HJfe©Jg8g 1 Cc <fcft 

is-rs^x©. ^-^xgrtfctf-^ooi^ccii 

tSIStt^©|S]±^«A^Ci*5-C#SiC^?ai^ 

[0 05 6] S/c y u-A©j£if"T:7®&!Si&ffic!&£ 
[00571ft*. ><-fy^Att*«*0&*M,»fcHte 

(c«> m-t ^A8g^iLt:oK:iac>#to»t:^3Jftffl 
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* [0052] ««c. mn:*&iHfL#& l 3 »!2©xf 
■^sti 6Kfe^t, ^wmmvcxm-mvim-rz 

Btc. WS^MJWiitee^R 1 2©&S£U/c&jSfcPif 

m 5 ©tmt ofc*raaw>*tt*f8-c* 
io <8> oxstcmmxmzftn-rz. c©^ 

[0053] 
(x, w) /N (x) 
>0*ON (x, w) >0©t§£ 

>0*-5N (x. w) = 0©*fr£ 
N (x. C) =0©i#£ 

(8) 

20 

[005 8] siifi©»®2 . ;x«c, c©^©S'J©HiS 
BNtVK:40tt«PIJ| • *5*5£«©<t:5&#SK. A 
&BJ©fli£©B^2tt^©^g|Jttl$£^£U SRI® 

©?5x^5tisfift»ft ljc ettwjcftfisr * &©-e 

[ 0 0 5 9 ] B 7 «■£©<*: 5 & C ©SSW©SIJfi©0«8 2 
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